                    ****************************************
                                  RELEASE NOTES

                    ****************************************

                Chelsio Native Network Driver with SR-IOV support
                             for VMware ESXi 6.X  
		           


++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
1. Native Network (NIC) Driver
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Version : 1.1.0.31
Date    : 01/27/2017
================================================================================

1. CHANGES
----------------------------------------

- Upgraded firmware to 1.16.29.0.
- Fixed the PSOD observed on unloading driver after mailbox timed out. 
- Fixed the VLAN priority setting related issues.
- Added support to control Link FEC.



2. ERRATA (Open Issues)
----------------------------------------

- 32043: iozone is hung and incomplete on nfs mounted partition through vxlan.

- 31922: [ESXi 6.0]T62100-LP-CR shows link speed "34464Mbps"

NOTE: This is an OS issue; not a driver issue. It will not be seen on ESXi 6.5.

- 31562: VM with 4.X kernel panics on loading cxgb4vf driver with vCPUs>2.

NOTE: This is an OS issue; not a driver issue. It will not be seen on ESXi 6.5.

- 31430: T6 link fails to come up with few switches.

Workaround: Disable autonegotiation on the switches.

- 30452: "SRIOVNIC" stats do not increment on the host. 

- 29607: Enabling LRO in the module option shows less performance, when LRO is 
         also enabled in Linux Virtual machine.
    


================================================================================
================================================================================



Version : 1.1.0.28
Date    : 12/30/2016
================================================================================

1. CHANGES
----------------------------------------

- Upgraded firmware to 1.16.26.0.
- Fixed the Setting exact match filter failure messgaes observed in dmesg after 
  powering on 14th VM.
- Fixed the "Unknown firmware reply 128" messages seen with VXLAN traffic.
- Fixed the "resetting adapter 1" messages seen and traffic stall with VXLAN traffic.
- Added support for T62100-CR adapter.
- Added option to access FW configuration file from Flash.
- Added support for ESXi 6.5.



2. ERRATA (Open Issues)
----------------------------------------

- 32043: iozone is hung and incomplete on nfs mounted partition through vxlan.

- 31922: [ESXi 6.0]T62100-LP-CR shows link speed "34464Mbps"

NOTE: This is an OS issue; not a driver issue. It will not be seen on ESXi 6.5.

- 31562: VM panics on loading cxgb4vf driver with vCPUs > 2.

- 31430: T6 link fails to come up with few switches.

Workaround: Disable autonegotiation on the switches.

- 31257: Buffer group drops observed while running heavy traffic on T6.

- 30452: "SRIOVNIC" stats do not increment on the host. 

- 29607: Enabling LRO in the module option shows less performance, when LRO is 
         also enabled in Linux Virtual machine.

- 29102: Errors counters increment while running traffic on standby uplink.
     


================================================================================
================================================================================



Version : 1.1.0.22 (Beta)
Date    : 12/05/2016
================================================================================

1. CHANGES
----------------------------------------

- Upgraded firmware to 1.16.22.0.
- Fixed the issue probe of VF fails if VMs attached with VFs are brought UP at a
  time.
- Added VXLAN offload support for T6/T5.



2. ERRATA (Open Issues)
----------------------------------------

- 31737: dmesg shows "FAIL - t4_change_mac: Setting exact match filter" message 
         repeatedly after powered on 14th VM.

- 31833: [T6]: Traffic stalls intermittently with VXLAN configured.

- 31430: T6 link fails to come up with few switches.

Workaround: Disable autonegotiation on the switches.

- 31257: Buffer group drops observed while running heavy traffic on T6.

- 29607: Enabling LRO in the module option shows less performance, when LRO is 
         also enabled in Linux Virtual machine.

- 29102: Errors counters increment while running traffic on standby uplink.
     
- 29072: Changing MTU while running bidirectional traffic is not recommended.



================================================================================
================================================================================



Version : 1.1.0.15 (Alpha)
Date    : 11/11/2016
================================================================================

1. CHANGES
----------------------------------------

- Upgraded Firmware to 1.16.12.0.
- Added support for T62100-LP-CR and T6225-CR adapters.




2. ERRATA (Open Issues)
----------------------------------------

- 31562: VM panics on loading cxgb4vf driver with vCPUs >2.

- 31561: Collecting cudbg logs is not supported.

- 31551: T6 PF4,PF5 and PF6 are not listing as Chelsio Communications.

- 31547: T6 Firmware Version is not shown using esxcli command.

- 29607: Enabling LRO in the module option shows less performance, when LRO is 
         also enabled in Linux Virtual machine.

- 29102: Errors counters increment while running traffic on standby uplink.



================================================================================
================================================================================



Version : 1.1.0.11
Date    : 10/31/2016
================================================================================

1. CHANGES
----------------------------------------

- Upgraded Firmware to 1.16.4.0.
- Fixed PSOD during driver load unload while traffic is running.
- Fixed failures seen during VMware ESX certification.
- Added SR-IOV support.
- Added support to tune Adapter for ESX, to see better performance.
- Improved Rx performance.



2. ERRATA (Open Issues)
----------------------------------------

- 29897: Probe of VF fails if VMs attached with VFs are brought UP at a time.

- 29607: Enabling LRO in the module option shows less performance, when LRO is 
         also enabled in Linux Virtual machine.

- 29102: Errors counters increment while running traffic on standby uplink.
     
- 29072: Changing MTU while running bidirectional traffic is not recommended.



================================================================================
================================================================================



Version : 0.0.1.42
Date    : 04/11/2016
================================================================================

1. CHANGES
----------------------------------------

- Fixed issue of PSOD observed during vmkstress test.
- Integrated cxgbtool into cxl driver vib.
- Fixed low performance seen for Windows Virtual machines for few traffic 
  patterns.



2. ERRATA (Open Issues)
----------------------------------------

- 29607: Enabling LRO in the module option shows less performance, when LRO is 
         also enabled in Linux Virtual machine.

- 29102: Errors counters increment while running traffic on standby uplink.
     
- 29072: Changing MTU while running bidirectional traffic is not recommended.
		 
		 
		 
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
2. Firmware
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

2.1. T6 Firmware
================

Version : 1.16.29.0
Date    : 01/27/2017
================================================================================

FIXES
-----

BASE:
- Set multiple fec values only if AN is enabled in config file and when module 
  is connected.
- Fixed intermittent DDR3/4 ECC errors.
- max number of ethctrl queue in VF set to 2 (reverted the last change
  because it causes problem in VF drivers).

ETH:
- Made devlog more verbose by printing cable information in redable form.
- Updated AN settings to work with more 25G/100G switches.
- Added support for more SFP28/QSFP28 cables.
- Fixed an issue of link going down after few hours of idle time.

OFLD:
- Fixed an issue in TLS which was causing fw crash on running TLS traffic.

FOiSCSI:
- Fixed the failure of PXE boot OS install on an iscsi lun.


ENHANCEMENTS
------------

OFLD:
- Added filtering support for NAT. New WR FW_FILTER2_WR and
  FW_PARAMS_PARAM_DEV_FILTER2_WR added for the same.
- Added RDMA guest mode (mode 3 or RDMA from VF) support.



================================================================================
================================================================================



Version : 1.16.26.0
Date    : 12/28/2016
================================================================================

FIXES
-----

BASE:
- Max number of egress and control queues adjusted to accomodate co-processor
  mode queues.
- Fixed intermittent DDR3/4 ECC errors.
- Fixed a traffic stall when ETS BW is configured as 0%.
- Max number of ethctrl queue in VF set to 1.


ETH:
- Added a new config file option 'speed' under port section to set the port speed. 
  Use only when auto negotiation is off.
- FEC option removed from firmware config file. cxgbtool can be used to change the 
  fec setting.
- CPL_TX_TNL_LSO cpl handling added in ETH_TX_PKT_VM handler. This fixes
  large tunnel tcp packet support for VxLAN.


================================================================================
================================================================================



Version : 1.16.22.0
Date    : 12/02/2016
================================================================================

FIXES
-----

BASE:
- fw_port_type updated in fw API to match kernel.org definations.
- Saved power by disaling unused MAC lanes.
- Configures correct power bin.
- Enhanced DDR4 performance.
- Enabled interrupts.
- Fixed an issue where filter rule for 'unicast hash' is not working.

ETH:
- Disabled auto negotiation by default because most of 100G switches do not
  support AN as of today.
- Fixed flow control not getting disabled problem.
- Fixed an issue where port0 doesn't come up sometimes.
- Fixed 10G link not coming up issue.
- Fixed an issue with promiscuous mode when dcbx disabled.

OFLD:
- Fixed a connection stuck issue when abort is received during out of tx pages
  backpressure.


ENHANCEMENTS
------------

BASE:
- Added inline TLS mode support.



================================================================================
================================================================================



Version : 1.16.12.0
Date    : 11/11/2016
================================================================================

ENHANCEMENTS
------------

BASE:
- Added T6 support.
- Added T6 1G/10G/25G/40G/100G link speeds.
- Added T6 co-processor mode crypto support.
- Added facility to increase link AN+AEC timeout.

OFLD:
- Added support for all T5 offload protocols except FCoE.

iSCSI:
- iscsi completion moderation enabled.



2.2. T5 Firmware
================

Version : 1.16.29.0
Date    : 01/27/2017
================================================================================

FIXES
-----

BASE:
- max number of ethctrl queue in VF set to 2 (reverted the last change
  because it causes problem in VF drivers).

FOiSCSI:
- Fixed the failure of PXE boot OS install on an iscsi lun.



ENHANCEMENTS
------------

OFLD:
- Added filtering support for NAT. New WR FW_FILTER2_WR and
  FW_PARAMS_PARAM_DEV_FILTER2_WR added for the same.
- Added RDMA guest mode (mode 3 or RDMA from VF) support.



================================================================================
================================================================================



Version : 1.16.26.0
Date    : 12/28/2016
================================================================================

FIXES
-----

BASE:
- Max number of ethctrl queue in VF set to 1.



================================================================================
================================================================================



Version : 1.16.22.0
Date    : 12/02/2016
================================================================================

FIXES
-----

BASE:
- Fixed an issue where filter rule for 'unicast hash' is not working.

ETH:
- Fixed an issue with promiscuous mode when dcbx disabled.


ENHANCEMENTS
------------

ETH:
- Added 40G-KR support.



================================================================================
================================================================================



Version : 1.16.12.0
Date    : 11/11/2016
================================================================================

FIXES
-----

BASE:
- Fixed multiple issues related with Filtering.
- Fixed an issue where LVDS output was not getting enabled using vpd.

ETH:
- Improved 40G link bringup time with few switches.

FOiSCSI:
- Fixed an issue where unloading foiscsi driver causes mailbox timeout.


ENHANCEMENTS
------------

OFLD:
- Added new WR FW_RI_FR_NSMR_TPTE_WR to improve fast MR write performance in RDMA.



================================================================================
================================================================================



Version : 1.16.4.0
Date    : 10/31/2016
================================================================================

FIXES
-----

BASE:
- Fixed multiple issues where FLR from multiple VFs can cause firmware crash.
- Fixed channel assignment based on number of ports in adapter.
- Fixed the HELLO command master force api to handle the 2nd HELLO correctly
  without getting BYE from the PF driver.
- Added facility to retrieve Serial configuration and VPD version. Two new
  FW_PARAMS_CMD[DEV] options added to retrieve these values.
- Fixed multiple issues where FLR from multiple VFs are not completing.
- Added new RSS hash secret key modes.
- A warning is printed in firmware log if PCI-E cookie generation is enabled in 
  serial initialization file.

DCBX:
- Fixed an issue where iscsi tlv is sent incorrectly to host (DCBX CEE).
- Fixed an issue where app priority values are not handled correctly
  in fw (DCBX IEEE).

ETH:
- Adjusts the link related delay timings according to the QSFP spec.
- Changed 2.5G mac speed bit to 25G mac speed bit in fw API.

OFLD:
- Do not reserve qp/cq if rdma capability is not enabled.
- Fixed an issue where approx 1600+ TOE connections were causing a firmware
  fatal error.
- Fixed DSGL memory write in T5. Now iwarp and iscsi can use DSGL to do
  memory write.
- Fixed multiple issues in hash filter mode where incorrect protocol mask was
  getting used and affecting hash filter functionality.

FOiSCSI:
- Fixed an issue in foiscsi recovery path.
- Fixed an issue where foiscsi (in VM in PCIE passthrough mode) didn't come 
  up after VM FLR.


ENHANCEMENTS
------------

ETH:
- Implemented 1G/10G KR/KX ability.
- Implemented T540-BT adapter support.



================================================================================
================================================================================



Version : 1.15.37.0
Date    : 04/27/2016
================================================================================

FIXES
-----

ETH:
 - Fixed a link flap issue on T580-CR.

FOiSCSI:
 - Fixed an issue where fw was sending ENETUNREACH event for normal tcp
   disconnection.

DCBX:
 - Fixed an issue where iscsi tlv is sent incorrectly to host (DCBX CEE).
 - Fixed an issue where apply bit set for APP id was affecting the ETS and PFC 
  settings (DCBX IEEE).
 - Fixed an issue where app priority values are not handled correctly in fw
  (DCBX IEEE).
 - Fixed an issue where enable/disable dcbx can cause crash (DCBX CEE,DCBX IEEE).

FOFCoE
 - Removed BB6 support.



================================================================================
================================================================================



Version : 1.15.28.0
Date    : 02/29/2016
================================================================================

FIXES
-----

BASE:
 - Fixed an issue in FW_RSS_VI_CONFIG_CMD handling where the default ingress
   queue was ignored.
 - Fixed an issue where adapter failed to load fw by adjusting DRAM frequency.
 - Fixed an issue in watchdog which was causing VM bring-up failure after reboot.
 - Fixed 40G link failures with some switches when auto-negotiation enabled.
 - Fixed to improve on link bring-up time.
 - Per port buffer groups size doubled to improve performance.
 - Fixed an issue where bogus d3hot bits were set causing traffic stall.
 - Fixed an issue where sometimes adapter was not seen after reboot.
 - Fixed an issue where iWARP was crashing in conjunction with traffic management.
 - Fixed an issue where link failed to come up after removing twinax cable and
   inserting optical module.

OFLD
 - Fixed a potential iSCSI data corruption issue by disabling RxFragEn flag.

FOiSCSI
 - Fixed an issue in recovery path where connection was getting closed before 
   recovery processing was done.
 - Fixed an issue in TCP port reuse.
 - Fixed an issue in recovery path when large number (>64) of iSCSI connections
   were in use.
 - Returned ENETUNREACH if IP was not been provisioned yet and driver tried to 
   use given inerface.


ENHANCEMENTS
------------

BASE:
 - Added new interface to program DCA settings in SGE contexts; allow 32-byte
   IQE size
 - Added PTP interface fw_ptp_ts to support PTP Frequeny and Offset adjustment.
 - Added MPS raw interface.

ETH:
 - New mailbox command FW_DCB_IEEE_CMD api added for IEEE dcbx.

OFLD:
 - WR opcode is returned to host in cqe error response.
 
 
 





********************************************************************************
Copyright (C) 2017 Chelsio Communications. All Rights Reserved.

The information in this document is furnished for informational use only, is
subject to change without notice, and should not be construed as a commitment by
Chelsio Communications. Chelsio Communications assumes no responsibility or
liability for any errors or inaccuracies that may appear in this document or any
software that may be provided in association with this document. Except as
permitted by such license, no part of this document may be reproduced, stored in
a retrieval system,or transmitted in any form or by any means without the
express written consent of Chelsio Communications.